Effects of visual prominence cues on speech intelligibility
نویسندگان
چکیده
This study reports experimental results on the effect of visual prominence, presented as gestures, on speech intelligibility. 30 acoustically vocoded sentences, permutated into different gestural conditions were presented audio-visually to 12 subjects. The analysis of correct word recognition shows a significant increase in intelligibility when focally-accented (prominent) words are supplemented with head-nods or with eye-brow raise gestures. The paper also examines coupling other acoustic phenomena to brow-raise gestures. As a result, the paper introduces new evidence on the ability of the non-verbal movements in the visual modality to support audio-visual speech perception.
منابع مشابه
Audio-Visual Prosody: Perception, Detection, and Synthesis of Prominence
In this chapter, we investigate the effects of facial prominence cues, in terms of gestures, when synthesized on animated talking heads. In the first study a speech intelligibility experiment is conducted, where speech quality is acoustically degraded, then the speech is presented to 12 subjects through a lip synchronized talking head carrying head-nods and eyebrow raising gestures. The experim...
متن کاملEffects of simulated cataracts on speech intelligibility
Limited research is available on how well visual cues integrate with auditory cues to improve speech intelligibility in persons with visual impairments, such as cataracts. We investigated whether simulated cataracts interfered with participants' ability to use visual cues to help disambiguate a spoken message in the presence of spoken background noise. We tested 21 young adults with normal visu...
متن کاملSynFace - Speech-Driven Facial Animation for Virtual Speech-Reading Support
This paper describes SynFace, a supportive technology that aims at enhancing audio-based spoken communication in adverse acoustic conditions by providing the missing visual information in the form of an animated talking head. Firstly, we describe the system architecture, consisting of a 3D animated face model controlled from the speech input by a specifically optimised phonetic recogniser. Seco...
متن کاملAided and unaided speech supplementation strategies: effect of alphabet cues and iconic hand gestures on dysarthric speech.
PURPOSE This study compared the influence of speaker-implemented iconic hand gestures and alphabet cues on speech intelligibility scores and strategy helpfulness ratings for 3 adults with cerebral palsy and dysarthria who differed from one another in their overall motor abilities. METHOD A total of 144 listeners (48 per speaker) orthographically transcribed sentences spoken with alphabet cues...
متن کاملSegmental differences in the visual contribution to speech inteligibility
It is well known that the presence of visual cues increases the intelligibility of a speech signal (Sumby & Pollack 1954). Although much is known about segmental differences in visualonly perception, little is known about the contribution of visual cues to auditory-visual perception for individual segments. The purpose of this study was to examine (1) whether segments differ in their visual con...
متن کامل